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TASK-BASED MULTIPROCESSING SYSTEM 
BACKGROUND 

1. Field of the Invention 

This invention relates to microprocessors. In particular, the invention relates to 
5 multiprocessing systems. 

2. Description of Related Art 

A typical multiprocessor system has a number of processors running in parallel. 
By decomposing a large problem into smaller tasks and allowing these tasks to be 
executed by concurrent processors, a significant speed improvement is achieved. There 
are, however, many challenges facing multiprocessor design. Examples of these 
challenges include cache coherency, snooping protocol, task allocation, 
communication, and parallel compilers. 

Current microprocessors having internal cache memories typically snoop 
internal caches for cacheable cycles seen on the multiprocessor bus. All cacheable 
agents have to complete the snoop activities before the cacheable cycle can complete. 
The snoop activities are often delayed because of slow tag timing or conflicts with on- 
going internal tag accesses. 

Therefore, there is a need to have an efficient mechanism to support task 
execution in a multiprocessing environment. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



The features and advantages of the present invention will become apparent from 
the following detailed description of the present invention in which: 

Figure 1 is a diagram illustrating a system in which one embodiment of the 
invention can be practiced. 

Figure 2A is a diagram illustrating a task manager according to one embodiment 
of the invention. 

Figure 2B is a diagram illustrating a multiprocessor system bus interface 
according to one embodiment of the invention. 

Figure 3 is a diagram illustrating a task cycle format shown in Figure 2 
according to one embodiment of the invention. 

Figure 4 is a diagram illustrating a task table shown in Figure 2 according to one 
embodiment of the invention. 

Figure 5 is a diagram illustrating a block allocation logic shown in Figure 2 
according to one embodiment of the invention. 
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DESCRIPTION 



An embodiment of the present invention is a task manager to manage tasks and 
maintain cache coherency on blocks of data associated with tasks in a multiprocessor 
system. A task table stores task entries corresponding to tasks executed by at least one 
5 processor. A block allocation circuit allocates blocks of the cache memory used by the 
tasks. A task coordinator coordinates the tasks in response to a task cycle issued by a 
processor. 

In the following description, for purposes of explanation, numerous details are 
set forth in order to provide a thorough understanding of the present invention. 
10 However, it will be apparent to one skilled in the art that these specific details are not 
required in order to practice the present invention. In other instances, well-known 
electrical structures and circuits are shown in block diagram form in order not to 
obscure the present invention. 

In a multiprocessor system, operating system distributes tasks to different 
15 processors to maximize parallelism. Tasks are partitioned program routines that can be 
executed in parallel. They are managed by the operating system through a table called 
"task table". The task table contains the states of active tasks. The state information is 
used by the operating system to determine the scheduling and resource sharing of tasks. 
The invention proposes a multiprocessor system architecture that performs transactions 
20 and maintains cache coherency on task basis instead of on cache line basis. The 

architecture provides a task table in the processor and associates each task with a cache 
state. It also changes the bus protocol to handle task-based transactions. 

A task is a partitioned program routine that can be viewed as an instruction 
block with or without a data block. A task may be partitioned into an instruction block 
25 and a data block. A block or task is the base unit for task transactions and task table. 
Each block is contiguous cache lines defined by a start address and the data block size. 
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As the tasks are distributed to different processors, the processor records the tasks in its 
cache. A cache state is attached to the task. For example, a task that is an instruction 
block may be recorded as "Shared" since it can be shared as read-only data by other 
processors. On the other hand, a task that is a data block may be recorded as 
5 "Exclusive" because the processor may modify it. With the task table, cache coherency 
can be performed on the tasks using the conventional Modified Exclusive Shared 
Invalid (MESI) cache protocol. The processors can snoop a task cycle on the bus, and 
check to see if it is recorded in the task table. If a task cycle "hits" the task table, then 
the processor can use the cache state to decide how it should respond to the cycle. Only 
10 one snoop activity is required for each task cycle, and that each task may contain N 
□ cache lines. Therefore, the snoop activities from are reduced from N to one. 

?Q Figure 1 is a diagram illustrating a computer system 100 according to one 

m embodiment of the present invention. The computer system 1 00 includes N processors 

s,s# 105, to 105 N} n processor buses 110, to 1 10 N corresponding to the N processors 105, to 

15 105 N , respectively, N task managers 127, to 127 N , N cache memories 136, to 136 N , N 
* multiprocessor system bus interfaces 139, to 139 N , a system bus 140, a system memory 

3 controller 150, a main memory 160, a system input/output (I/O) controller 170, a mass 

storage device 172, a system input/output bus 180, and K I/O devices 1 85 1 to 185 K . 

Each of the processors 105, to 105 N represents a central processor of any type of 
20 architecture, such as complex instruction set computers (CISC), reduced instruction set 
computers (RISC), very long instruction word (VLIW), or hybrid architecture. The 
processors 105, to 105 N may have the same or different architectures but they all 
support the task-based processing protocol. For illustrative purposes, only the 
processor 105, is described. The processor 105, includes a processor core 1 12, a task 
25 manager 114, and a cache memory 116, and a processor bus interface 118. The 

processor core 112 includes the core circuitry of the processor such as an instruction 
decoder, arithmetic and logic unit, instruction issuing unit, etc. The task manager 1 14 
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may be referred to as internal task manager. It manages the tasks executed by the 
processor 105,. The cache memory 116 may contain program and data, and data blocks 
used by the task manager 114. The cache memory 1 16 is also referred to as the internal 
cache or level 1 (LI) cache. The processor 105,, the task manager 114, and the cache 
5 memory 116 interface with the processor bus 1 10 via the processor bus interface 118. 

The processor bus 110 allows the processor 105 to access the task manager 127 
and the cache memory 136. There are also other normal activities on the processor bus 
1 10. The task manager 127 may be referred to as external task manager. It manages 
the tasks in conjunction with the cache memory 136. The cache memory 136 is also 
10 referred to as the external cache or level 2 (L2) cache with respect to the processor 105. 
The multiprocessor system bus interface 139 allows the task manager 127, the cache 
memory 136, and the processor 105 to access to the system bus 140. 

The system bus 140 is a multiprocessor bus to allow N processors 105, to 105 N 
to access the main memory 1 60 and to perform other bus-related activities such as 

15 broadcasting cycles, decoding cycles, snooping, etc. The system memory controller 
150 controls the use of the main memory 130 and has an interface to the system I/O 
controller 170. The system memory controller 125 may additionally contain a task 
manager 155. The task manager 155 is optional and may be used for a multiple 
multiprocessor systems. The task manager 1 55 is essentially similar to the task 

20 managers 114 and 127. The task table associated with the task manager 155 may be 

located inside the task manager 155 or outside the system memory controller 150. The 
main memory 130 represents one or more mechanisms for storing information. For 
example, the main memory 130 may include non-volatile or volatile memories. 
Examples of these memories include flash memory, read only memory (ROM), or 

25 random access memory (RAM). The system main memory 130 may contain a task 

manager code 134 to support the task manager 1 14, and/or 127, and/or 155, a program 
131 and other programs and data 138. Of course, the main memory 130 preferably 
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contains additional software (not shown), which is not necessary to understanding the 
invention. 

The system I/O controller 170 provides interface to I/O devices and the system 
I/O bus 180. The mass storage devices 172 include CD ROM, floppy diskettes, and 
5 hard drives. The system I/O bus 180 provides high-speed I/O accesses. An example of 
the system I/O bus 180 is the Peripheral Component Interconnect (PCI) bus. The I/O 
device 185, to 185 K are peripheral devices performing dedicated tasks. Examples of the 
I/O devices include direct memory access controller (DMAC), input/output processors 
(IOP), network interface and media interface devices. The network interface connects 
10 to communication networks such as the Internet. The Internet provides access to on- 
line service providers, Web browsers, and other network channels. The media interface 
provides access to audio and video devices. 

The task managers 110, 127 and 155 may be implemented by hardware, 
firmware, software or any combination thereof. When implemented in software, the 

15 elements of the present invention are essentially the code segments to perform the 

necessary tasks. The program or code segments can be stored in a processor readable 
medium or transmitted by a computer data signal embodied in a carrier wave, or a 
signal modulated by a carrier, over a transmission medium. The "processor readable 
medium" may include any medium that can store or transfer information such as the 

20 mass storage devices 1 72. Examples of the processor readable medium include an 
electronic circuit, a semiconductor memory device, a ROM, a flash memory, an 
erasable ROM (EROM), a floppy diskette, a compact disk CD-ROM, an optical disk, a 
hard disk, a fiber optic medium, a radio frequency (RF) link, etc. The computer data 
signal may include any signal that can propagate over a transmission medium such as 

25 electronic network channels, optical fibers, air, electromagnetic, RF links, etc. The 
code segments may be downloaded via computer networks such as the Internet, 
Intranet, etc. 
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All or part of the task manager and/ or task coordinator may be implemented by 
software. The software may have several modules coupled to one another. A software 
module is coupled to another module to receive variables, parameters, arguments, 
pointers, etc. and/or to generate or pass results, updated variables, pointers, etc. A 
5 software module may also be a software driver or interface to interact with the 

operating system running on the platform. A software module may also be a hardware 
driver to configure, set up, initialize, send and receive data to and from a hardware 
device. 

Figure 2 A is a diagram illustrating the task manager 1 14 or 127 shown in Figure 
4SB5 10 1 according to one embodiment of the invention. The task manager 114 includes a task 

= :;~ table 210, a block allocation circuit 220, and a task coordinator 230. 

i. ! * 

The internal task manager 114 and external task manager 127 are essentially 
^ similar. The main difference is the interface circuitry to the bus and the memory. The 

task table 210 stores task entries corresponding to tasks executed at least one of the 
;n 15 processors 105, to 105 N . The task table 210 provides a means to keep track of the tasks 

. Li 

3 obtained or executed by the processors 105, to 105 N . As will be described later, each 

3 task entry has a task identifier (ID) that uniquely identify a task. The task table 210 

may be implemented as a fully associative memory. 

The block allocation circuit 220 allocates blocks of the cache memory used by 
20 the tasks. The block allocation circuit 220 is interfaced to the bus interface 205 and the 
internal cache memory 1 16 or the external cache memory 136. The block allocation 
circuit 220 monitors the usage of data blocks in the cache memory 1 16 or 136 and 
locates available blocks when requested by a task. When a new task is broadcast on the 
system bus 140, the processors compete with one another to acquire the task. The 
25 availability of free, uncommitted resources and task priority setting in a processor 
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affects how fast it can obtain the task. The block allocation circuit 220 searches for a 
free block of cache that satisfies the task requirement. 

The task coordinator 230 coordinates the tasks in response to a task cycle issued 
by at least one of the processors 1 10, to 1 10 N . The task coordinator 230 interfaces to 
5 the processor core 1 1 2 and the internal cache memory 1 1 6 or the external cache 

memory 136 to coordinate activities of the tasks. The task coordinator 230 include a 
task table updater 232, an address generator 234, and a busy flag generator 236. 

The task table updater 232 is responsible for updating the task table 210 when 
new tasks are acquired. The updating includes writing information about a task entry to 

10 the task table 210. The task table updater 232 also reads the task table 210 to determine 
the status of a particular task. Upon detection of a task cycle on the bus, the task table 
updater 232 compares the task ID associated with the detected task cycle with those 
task ID's in the task table 210 to determine if there is a hit. The address generator 234 
generates address to the cache memory 1 16 or 136. The address generator 234 is 

15 initially loaded with the starting address of the data block associated with the task and 
points to or indexes to the physical locations of the corresponding cache memory 116 
or 136. As will be explained later, the starting address of the data block is stored in the 
task table 210 when the task is first acquired by the processor. When the task manager 
230 is used for internal cache memory 116, the address generator 234 includes a 

20 program counter to keep track of the address of the instruction being executed and a 
data counter to point to the data. The busy flag generator 236 provides busy flag 
signals and a search start/end signal to the block allocation circuit 220. Each of the 
busy flag signals corresponds to a chunk of memory in the cache memory 1 16 or 136. 
If the chunk of memory is in use, the corresponding flag signal is asserted, otherwise it 

25 is de-asserted. The search start/end signal is used to initiate a search for free blocks 
when a task requires data block (for internal task controller 1 14) or the host bridge 
chipset 120 or the external processor bus 110 (for external task controller 127). 
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Figure 2B is a diagram illustrating the multiprocessor system bus interface 139 
shown in Figure 1 according to one embodiment of the invention. 

The multiprocessor system bus interface 139 provides interface to the system 
bus 1 40. The processor interface 240 includes a task cycle decoder 242 and a task 
5 command decoder 244. The task cycle decoder 242 decodes cycle signals generated by 
the processor core 1 12 or broadcast or directs to a specific processor on the system bus 
140 when a cycle is initiated. A processor cycle may be task related or non-task 
related. A non-task related cycle is treated as a normal cycle and is handled in the 
normal processing sequence. A task related cycle contain task information according to 
10 a task cycle format 245. The task command decoder 244 decodes the task command in 
the task cycle and provides appropriate action according to the decoded command. 

In addition to the task table, a bus protocol is developed to handle tasks 
efficiently. A task cycle transfers the information and data of a task on the system bus. 
The task identifier (ID) is divided into two phases: request phase and data phase. The 

15 request phase carries the task command, address and block size information. The task 
ID and a unique transaction ID are attached to the request phase. The data phase 
transfers the data associated with the task. It is also attached with the transaction ID, 
and is de-coupled from the request phase. The length of the data phase is determined 
by the data block size. To balance the bus bandwidth use by different processors, the 

20 data phase may be interrupted by another processor requesting data transfer. An 

interrupted data transfer can later resume and be picked up by the owner based on the 
transaction ID. If processor 1 issues a task cycle that matches a task ID in the processor 
2's task table, processor 2 is required to check the cache state in the task table and 
perform cache coherency activities. This may include update cache state, drive 

25 appropriate snoop response, and execute write back cycles. If processor 2 is still 

performing data transfer for the task, processor 2 remembers the required coherency 
activities and carry them out in appropriate time. The main memory may also contain a 
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task table that tracks all the tasks acquired by the processors. The main memory task 
table allows the elimination of snoop phase and simplifies the bus protocol to only 
request and data phases. In addition, the table also acts as snoop filter in a multi system 
bus design. Since cache coherency is done by communicating with task cycles, it is 
5 important to maintain consistency of data block size of a task throughout the system 
until the task is invalidated. Single cache line cycles are still allowed in the system. 
Single cache line cycle can be defined as a task cycle with block size of one cache line. 
It, however, is much less efficient than a block size accesses, and should be limited to 
semaphore or mailbox operations. 

10 Figure 3 is a diagram illustrating the task cycle, format 245 shown in Figure 2B 

according to one embodiment of the invention. The task cycle format 245 includes a 
task identifier (ID) 310, a task command 320, a start address 330, and a task block size 
340. 

The task ID 310 is used to identify or name a task in a unique manner within a 
15 processing session. Each different task whether executed by the same processor or 
different processors has a different task ID. Similarly, a task may be executed by a 
processor or different processors but has only one unique ID. The task command 320 
specifies the type of operation to be operated on a task. There may be several types of 
operations. In one embodiment, the task command 320 includes a read shared 
20 command 322, a read_exclusive command 324, a write command 326, and a flush_task 
command 328. The read_shared command 322 is used to read a data block as shared, 
e.g., the data block is shared by more than one processor. The read_exclusive 
command 324 is used to read a data block as exclusive, e.g., the data block is used by 
the requesting processor exclusively. The write command 326 is used to write the data 
25 block to the main memory. For example, when the processor evicts a task that has been 
modified, the flush_task command 328 is used to invalidate a task. When a task is 
invalidated, if it contains modified data, the processor writes back all the modified 
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cache lines in the data block to the main memory, and invalidate the task after the 
modified cache lines have been transferred to the main memory. If the task contains no 
modified data, the task is invalidated. When a task is invalidated, its task ID can be re- 
used. 

5 The start address 330 specifies the starting address of the data block associated 

with the task. The task block size 340 specifies the size of the data block in terms of 
some size unit such as the cache line. 

Figure 4 is a diagram illustrating the task table 210 shown in Figure 2 A 
according to one embodiment of the invention. The task table 210 includes L task 
1 '!? 10 entries 410, to 41 0 L organized into a status field 420, a task ID field 430, a start address 

J;L! field 440, a task block size field 450, and a cache address field 460. 

^ Each of the task entries 410, to 410 L contains information about a task. The 

W status field 420 indicates the status of a task. The status may be modified, invalid, 

□ shared, and exclusive. A modified status indicates the task has been modified. An 

j 15 invalid status indicates that the entry in the task table is unused and its fields are 

5 invalid. A shared status indicates that the task or the data block associated with the task 

is shared with one or more processors. An exclusive status indicates that the task or the 
data block associated with the task is used exclusively by one processor. The task ID 
field 430 contains the task ID of the task, e.g., task ID 310. This task ID is unique to 
20 the task in the active session in which tasks are running. The start address field 440 
contains the start address of the data block associated with the task, e.g., start address 
330. The task block size field 450 contains the task block size, e.g., task block size 
340. The cache address field 460 contains the start physical address of the cache 
memory that stores the data block associated with the task. 

25 In the illustrative example shown in Figure 4, the task entry 410, has an invalid 

status. The task ID, start address, task block size, and cache address are don't cares and 
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may contain any values. The task entry 410 2 corresponds to task ID 00100 with a 
shared status. The start address, task block size, and the cache address of the task ID 
00100 are 0100 000, 0000 1000, and 000100, respectively. Similarly, the entries 410 L 
corresponds to task ID 00080 having an exclusive status. The start address, task block 
5 size, and the cache address of the task ID 00080 are 0040 000, 0000 0100, and 006800, 
respectively. 

The task table is typically large enough to hold sufficient number of task entries. 
When the number of task entries exceeds the task table size, old task entries are evicted 
to make room for new task entries. The cache lines associated with the evicted task are 
10 invalidated. The eviction, or replacement, of the old task entries in the task table may 

r j 

' 3 be performed using a number of techniques. Examples of these techniques include a 

Q first-in-first-out replacement, least recently used replacement, or any other techniques 

j;S used in tag replacement. The task table may also contains the task state for scheduling 

= 3 purpose. The task may be in the state of ready, sleep, active, or terminated. Ready 

yj 15 state indicates the task is ready to be executed. Sleep state indicates the task is 

i I temporally suspended until an event to wake it up. Active state means the processor is 

:;!? executing the task. Terminated state means the task was terminated. The task states are 

updated by the processor/operating system as it acquire, execute, suspend, or terminate 
tasks. Different algorithms can be developed to divide the processor resources to the 
20 tasks in different states. 

Figure 5 is a diagram illustrating the block allocation circuit 220 shown in 
Figure 2 according to one embodiment of the invention. The block allocation circuit 
220 includes a search logic circuit 510 and a block information generator 530. 

The search logic circuit 510 determines a list of candidates free blocks of 
25 memory by scanning through the busy flag signals provided by the busy flag generator 
236 (Figure 2). The busy flag indicates if the resource (e.g., memory) is busy or free. 
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The search logic circuit 510 includes a pass/invert logic 512 and a scanning logic 520. 
The search starts when the search start/end signal is asserted and stops when the search 
start/end signal is de-asserted. The pass/invert logic 512 allows the busy flag signals to 
pass through or invert the polarity. The scanning logic 520 includes a barrel shifter 522 
5 and a register 524. To spread out utilization, the flags are fed into the barrel shifter 522 
for round robin prioritization. The barrel shifter 522 also rotates the flag order for the 
searching of the end address of the block. The block information generator 530 
provides the block information such as the block size, the starting address and the 
ending address of the block. The block information generator 530 includes a priority 

10 encoder 532 and an adder 534. The priority encoder 532 performs the search. The 
adder 534 offsets the rotation of the barrel shifter 522 to give the correct start/end 
location of a free block. In one embodiment, the process takes two steps to find a free 
block. A step may correspond to a clock cycle or some predefined time interval. In the 
first clock, the process searches for the start address of a free block. The busy flags are 

15 inverted and rotated by the barrel shifter. The priority encoder and adder identify the 

start address of a free block. In the second clock, the block search logic passes the busy 
flags to the barrel shifter without inversion. The barrel shifter rotates the flags such that 
the previously found start address is in the highest priority position so that the search 
begins there. The priority encoder and the adder then find the end address of the free 

20 resource block; hence the block size can be determined by the difference between the 
start address and the end address. In this case, the block size is simply the output from 
the priority encoder without the offset from the adder. 

Tasks in the system can be managed in several different way. The operating 
system may give a task to a specific processor, or by asking a free processor to grab a 
25 task. The processor that is handling the task distribution may issue a task cycle that is 
directed to a specific processor. The targeted processor receives the task 
unconditionally. By contrast, a task may be broadcasted. In this case, all processors 
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participate in acquiring the task. Different criteria determine who will get the task. For 
example, each processor may contain a priority register. A task cycle is attached with a 
priority. The processors whose priority register values are less than the task priority are 
excluded from participating task acquisition. Another determining factor is the 
5 availability of free resources in the processor. Free resource may include memory space 
and processor availability, which affects how quickly it can respond to the task. The 
first responding processor, which has largest amount of free resources wins the task. 

When a new task cycle is broadcast on the system bus, the first processor who 
determines that it can accept the task issues a task cycle in response. Upon detection of 
. ra4 10 the task cycle, the other processors cancel their attempts to acquire the same task. If no 

::!? processor has sufficient resource, a timer that is inverse proportional to the amount of 

j;^ free resource in an agent counts down. When the timer expires, the agent issues a task 

fly 

i. B cycle to acquire the task. In this way the agent that has the largest amount of resource 

Q will win the task. The agent will have to evict tasks to make room for the new task. 

O 15 Sometimes a task may contain too large a block of data that is difficult and inefficient 

la to handle. In this case, a large task may be divided into smaller manageable tasks by 

1=5 the operating system. A task cycle may be either of loading a task or of executing a 

task. The loading of task asks the processor to load a task into its memory. The 
processor is responsible to prioritized the loaded tasks and execute them. The task 
20 cycle can also be execution of a task. When the task cycle is issued, the 

processor/processors that contain the task are forced to execute it immediately. If no 
processor has the task loaded, then the processor is required to load the task and execute 
it. 

The task cycle is divided into two phases: request phase and data phase.. The 
25 data phase of the transfer may be attached with the task ID and decoupled from the 
request phase. In other words, there is no strict ordering of the data transfer in the 
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request order. Task 1 may occur before task 2 but data for task 2 may occur before task 
1. 

When a new task is acquired, the new task information from the request phase is 
loaded to the LI and L2 task tables. The processor keeps the task schedule in its task 
5 table. For example, a task tracked in the task table may have states of busy, sleep, 
ready, or terminated. The processor is responsible to prioritize the tasks execution. 
After the request phase, the data is transferred either from the main memory or from a 
snooping agent responding to the task cycle. LI and L2 cache address counter are first 
initialized with the physical addresses of their respective free cache memory blocks. 

10 The counters are used to index to the physical locations of the cache RAMs during the 
data transfer. Depends on the processor design, the processor may begin executing the 
task before the data block transfer completes. Once the data block is in the cache 
RAMs, the processor can index to the LI cache with its program or data counters as it 
begins to process the task. The processor may receive another request via a broadcast 

15 cycle on the multiprocessor bus for a new task already in its cache. In this case, it can 
respond to the request immediately by issuing a snoop response. Upon observing the 
snoop response, the processors do not participate in acquiring the task . Other times, 
requests of cached tasks may come from the task the processor is executing; then no 
task cycle is generated. Since the system functions based on tasks and the data blocks, 

20 the code associated with the task is most efficiently handled with relative addressing 
method and branching within the data block. Single cache line access is allowed in the 
system. This is done in the request phase of a bus cycle by the explicitly indication of 
single cache line access. In general, single cache line cycle never accesses the data 
block region. However, single cache line accesses within a task data block is still 

25 allowed provided that the final cache state is consistent with the task cache state, and 
that the data is always kept consistent between the single cache line cache and data 
block cache. For single cache lines, a small size cache RAM and tag RAM are used in 
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the processor to track them. Due to the small size tag RAM, single cache line accesses 
should be avoided as much as possible, preferably restricted to mailbox 
communications. 

While this invention has been described with reference to illustrative 
embodiments, this description is not intended to be construed in a limiting sense. 
Various modifications of the illustrative embodiments, as well as other embodiments of 
the invention, which are apparent to persons skilled in the art to which the invention 
pertains are deemed to lie within the spirit and scope of the invention. 
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